Under consideration for publication in Theory and Practice of Logic Programming 



1 



Disjunctive Datalog with Existential Quantifiers: 
Semantics, Decidability, and Complexity Issues 

MARIO ALVIANO, WOLFGANG FABER, NICOLA LEONE, MARCO MANNA* 

Department of Mathematics, University of Calabria, Italy 
(e-mail: {alviano,f aber,leone,manna}@mat .unical. it) 

submitted 1 January 2003; revised 1 January 2003; accepted 1 January 2003 

Abstract 

Datalog is one of the best-known rule-based languages, and extensions of it are used in 
a wide context of applications. An important Datalog extension is Disjunctive Datalog, 
which significantly increases the expressivity of the basic language. Disjunctive Datalog is 
useful in a wide range of applications, ranging from Databases (e.g., Data Integration) to 
Artificial Intelligence (e.g., diagnosis and planning under incomplete knowledge). However, 
in recent years an important shortcoming of DataJog-based languages became evident, e.g. 
in the context of data-integration (consistent query-answering, ontology-based data access) 
and Semantic Web applications: The language does not permit any generation of and 
reasoning with unnamed individuals in an obvious way. In general, it is weak in supporting 
many cases of existential quantification. To overcome this problem, Datalog 3 has recently 
been proposed, which extends traditional Datalog by existential quantification in rule 
heads. In this work, we propose a natural extension of Disjunctive Datalog and Datalog 3 , 
called Datalog 3 ^ , which allows both disjunctions and existential quantification in rule 
heads and is therefore an attractive language for knowledge representation and reasoning, 
especially in domains where ontology-based reasoning is needed. We formally define syntax 
and semantics of the language Datalog 3 ' v , and provide a notion of instantiation, which 
we prove to be adequate for Datalog 3 ' v . A main issue of Datalog 3 and hence also of 
Datalog 3 '^ is that decidability is no longer guaranteed for typical reasoning tasks. In 
order to address this issue, we identify many decidable fragments of the language, which 
extend, in a natural way, analog classes defined in the non-disjunctive case. Moreover, we 
carry out an in-depth complexity analysis, deriving interesting results which range from 
Logarithmic Space to Exponential Time. 

To appear in Theory and Practice of Logic Programming. 
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1 Introduction 

Datalog has its origins as a query language in Database Systems, but the language, 
and in particular its extensions, have well gone beyond this original scope, and 
are now used in a variety of applications, see for example (|De Moor et al. 2011|) . 

* Marco Manna's work was supported by the European Commission through the European Social 
Fund and by Calabria Region. 
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Datalog y (Eit er et al. 19 97). an extension of Datalog in which rule heads may be 
disjunctions of atoms, proved to be especially rewarding in the context of AI, as 
it allows for the representation of concepts like incomplete knowledge and nondc- 
terministic effects in a simple and intuitive way. Examples for the use of Datalog y 
span from planning (jEiter et al. 2004[) . to data-integration (jLeone et al. 2005) . to 
reasoning with ontologies ([Hustadt et al. 2004)) . 

Concerning ontologies, we observe that the field of ontology-based Query Answer- 
ing (QA) is thriving in data and knowledge management (Calvancsc et al. 2007) 
ICali et al. 2009) IKollia et al. 2011} ICali et al. 2011[) . and companies such as Ora- 
cle are adding ontological reasoning modules on top of their existing software. In 
this context, queries are not merely evaluated on an extensional relational database 
D, but against a logical theory combining D with an ontological theory E. More 
specifically, £ describes rules and constraints for inferring intensional knowledge 
from the data stored in D ( |Johnson~a nd Klug 1984]). Thus, for a conjunctive query 
(CQ) q, it is not only checked whether D entails q, but rather whether DUE does. 

A key issue in ontology-based QA is the design of the language used for specifying 
the ontological theory £. To this end, Datalog ± , a family of extensions of Datalog 
proposed bv lCali et al.l (|2009|) for tractable QA over ontologies, has recently gained 
increasing interest (Mugnic r 201 1[ ). This family generalizes well-known ontology 
specification languages, and is mainly based on Datalog 3 , an extension of Datalog 
that allows existentially quantified variables in rule heads. 

In this paper we propose an extension of Datalog that allows for both disjunctions 
and existentially quantified variables in rule heads, called Datalog 3 :V . This language 
is highly expressive and enables easy and powerful knowledge-modeling, combining 
the ability of disjunction to deal with incomplete information, with the power of 
existential quantifiers to generate unnamed individuals and to deal with them. For 
example, consider a scenario where each animal is either a carnivore or a herbivore, 
and any carnivore preys at least one other animal. This knowledge can be modeled 
by the following Datalog 3 '^ rules (on the left-hand side) or in equivalent ontological 
terms (on the right-hand side): 



carnivore (X) v herbivore (X) <— animal (X) 
BY preys (X,Y) <— carnivore (X) 
animal (Y) <— preys (X,Y) 



Animal IZ Carnivore U Herbivore 
Carnivore C Bpreys . T 
3preys _1 .T C Animal 



In general, Datalog^' allows to naturally encode advanced ontology properties such 
as role transitivity, role hierarchy, role inverse, concept products and union of con- 
cepts. We define the syntax of the language and provide a formal semantics for QA 
over Datalog 3 ^ programs. Since QA over Datalog 3y is undecidable in the general 
case (as it is undecidable already on its subclass Datalog 3 ), we identify a num- 
ber of Datalog 3 ' v fragments where QA is decidable, lifting to the disjunctive case 
several decidability results proved bv ICali eF al. (2009). Moreover, we analyze the 
complexity of QA in Datalog 3 '^ by varying different parameters. More specifically, 
our main contributions are the following: 

► We define the novel language Datalog 3 ' v , extending both Datalog 3 and Datalog^ , 
and provide a formal definition for QA over this language. We also specify the 
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notion of universal model set, which generalizes the concept of universal model to 
the disjunctive case. A universal model set allows for answering any query. 

► We define the new concept of instantiation inst(P) of a Datalog 3 '^ program P, 
and show that it is adequate for QA. The finiteness of inst(P) is a sufficient condition 
to ensure the decidability of QA over P, since one can compute a finite model set 
of P from inst(P) in this case. We design a procedure for computing inst(P) and 
prove that it generalizes the oblivious chase procedure introduced by IMaier et al.l 
(|T979j) and | Johnson and Klug| (gSHU) . 

► We define the classes of guarded, linear, and weakly guarded Datalog 3y pro- 
grams. We show that: (i) they extend the corresponding classes of Datalog 3 pro- 
grams, (ii) checking membership in these classes is doable in polynomial time, and 
(iii) QA is decidable in these classes. 

► We carry out a complexity analysis to determine the data complexity of QA in 
all cases that are obtained by varying the following three parameters: (i) the query 
(atomic, conjunctive, or acyclic), (ii) the class of the underlying Datalog 3 ^ program 
(guarded, linear, weakly guarded, monadic-linear, or multi- linear) , (iii) the allowed 
Datalog extension (disjunction, existential variables, or both). 

To the best of our knowledge, this is the first paper proposing a dedicated exten- 
sion of Disjunctive Datalog with existential quantifiers, and analyzing its decidabil- 
ity and complexity. There have been some proposals (for example . IFerraris et al. 2011[) 
for interpreting arbitrary first-order formulas under the stable model semantics, 
which are more general than our approach, but have a rather different motivation 
and in particular do not address decidability issues. However, in the literature there 
are many studies concerning the decidability of (non-disjunctive) Datalog 3 frag- 
ments. The decidable subclasses of Datalog 3 rely on four main syntactic paradigms, 
called guardedness (jCali et al. 2008|) . weak-acyclicity ( |Fagin et al. 2005[ ), stickiness 
(jCali et al. 2010a|) . and shyness (jLeone et al. 2012]) . The guardedness paradigm 
will be discussed in depth in this paper and extended to the disjunctive case. 
Weak-acyclicity has originally been introduced in the context of data exchange, 
where programs are required to have finite universal models ( |Fagin et al. 2005 ). 
Further extensions have also been proposed in this context (jDeutsch et al. 20081 
IMarnette 20091 IMeier et al. 20091 IGreco et al. 201 Sticky Datalog 3 programs, 
defined more recently, have a low QA complexity and can express the well-known 
inclusion dependencies, but, since they are FO-rewritable, they have limited ex- 
pressive power. Several generalizations of stickiness have been defined bv lCali et al.l 
(|2010b|) . For example, the Sticky-Join class preserves the benign sticky complexity 
by also encompassing linear Datalog 3 programs. Finally, Shy, the newest among 
the syntactic Datalog 3 families, offers a good balance between expressivity and 
complexity. This class significantly extends both the class of Datalog and linear 
Datalog 3 programs, while preserving the same (data and combined) complexity of 
QA over Datalog, even though it includes existential quantifiers. 

The results in this paper complement the above-mentioned works, and contribute 
to a more complete picture of the computational aspects of QA over extensions of 
DataJogwith existential quantifiers, providing support for choosing the appropriate 
setting that fits particular needs in practical applications. 
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2 The Disjunctive Datalog^ Language 

In this section we introduce syntax and semantics of Datalog'^ programs and 
formally define the query answering problem. 

2. 1 Preliminaries 

The following notation will be used throughout the paper. We always denote by 
Ac, Ajv and Ay, countably infinite domains of terms called constants, nulls and 
variables, respectively; by A, the union of these three domains; by ip, a null; by X and 
Y, variables; by X and Y, sets of variables; by II an alphabet of predicate symbols 
each of which, say p, has a fixed nonnegative arity; by a, b and c, atoms being 
expressions of the form p(ii, . . . , tk), where p is a predicate symbol, and t\, . . . , tk is 
a tuple of terms. For an atom a, we denote by pred(a) the predicate symbol of a. 

For a formal structure c containing atoms, atoms(?) denotes the set of atoms in 
ft and terms(ft) denotes the set of terms occurring in atoms(ft). If X is the set of 
variables in ft i.e., X = terms(<r) n Ay, then <; is also denoted by qxi- A structure 
q0] is called ground. If T C A and T ^ 0, then base(T') denotes the set of all atoms 
that can be formed with predicate symbols in II and terms from T. 

2.1.1 Mappings 

A mapping is a function // : A — > A s.t. c E Ac implies //(c) = c, and ip E An 
implies fJ-(p) E Ac U Ajv. Let T be a subset of A. The application of // to T, 
denoted by //(X 1 ), is the set {//(£) | t E T}. The restriction of // to T, denoted by 
//|t, is the mapping //' s.t. //'(i) = //(i) for each t E T, and //'(i) = t for each 
t £ T. In this case, we also say that // is an extension of //', denoted by // D //'. 
For an atom a = p(h, . . . , tk), we denote by //(a) the atom p(/z(ti), . . . , //(4)). For 
a formal structure c containing atoms, we denote by //(<?) the structure obtained 
by replacing each atom a of <r with //(a). The composition of a mapping //i with a 
mapping // 2 , denoted by //2°//i, is the mapping associating each f G A to //2(Mi(i))- 
Let ?i and <;2 be two formal structures containing atoms. A homomorphism from 
ft to <^2 is a mapping s.t. /i(<Ti) is a substructure of ft (for example, if ft and ft are 
sets of atoms, ft(ft) C ft). An isomorphism between ft and ft is a bijective homo- 
morphism / from ft to ft. If such an isomorphism exists, ft and ft are isomorphic, 
denoted by ft ~ ft. A substitution is a mapping a s.t. t E An implies a(t) = t, 
and t E A v implies a(t) eA c UAjvU {t}. 

2.2 Programs and Queries 

A Datalog 3 '^ rule r is a finite expression of the form: 

VX3Y disj [x , uY] <- conj [x] , (1) 

where (i) X and Y are disjoint sets of variables (next called V-variables and El- 
variables, respectively); (ii) X' C X; (iii) disjj x , uY ] is a nonempty disjunction of 
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atoms; and (iv) conj[ X ] is a conjunction of atoms. Universal quantifiers are usu- 
ally omitted to lighten the syntax, while existential quantifiers arc omitted only 
if Y is empty, in which case r coincides with a standard Datalog' rule. The sets 
atoms(disj[ X , uY ]) and atoms(conjj x j) are denoted by head(r) and body(r), respec- 
tively. If body(r) = and head(r) | = 1, then r is usually referred to as a fact. In 
particular, r is called existential or ground fact according to whether r contains 
some 3- variable or not, respectively. 

A Dataiog 3 ' v program P is a set of Dataiog 3 ' v rules. W.l.o.g., we assume that 
rules in P do not share any variable. We denote (JreP head(r) by heads(P). 

A conjunctive query (CQ) q, also denoted by <?(X), is of the form: 

3Yconj [xuY] , (2) 

where X and Y are disjoint sets of variables, and conj[ XUY ] is a conjunction of 

atoms from base(X U Y U Ac). Variables in X are called free variables. Query q is 

called acyclic (ACQ, for short) if its associated hypergraph is acyclic ( |Chekuri and Rajaraman~ 2000) 

or, equivalently, if it has hypertree- width 1 (IGottlob et al. 19 99). A Boolean CQ 

(BCQ) is a query of the form © s.t. X is empty. An atomic query is a CQ of the 

form @ s.t. conj[ XuY ] consists of just one atom. 

2.3 Semantics 

Let M C base(Ac U Ajv). M is a model of a rule r of the form fl}, denoted by 
M (= r, if for each substitution a s.t. er(body(r)) C M, there is a substitution 
o~' 2 cr|x s.t. cr'(head(r)) n M ^ 0. M is a model of a Datalog B ' v program P, 
denoted by M |= P, if M (= r for each reP. Let mods(P) denote the set of all the 
models of P. Two programs P, P' are called FO-equivalent if mods(/ J ) = mods(P'). 

A BCQ q is true w.r.t. a model M, denoted by M \= q, if there is a substitution 
<7 s.t. cr(atoms(g)) C M. For a set of models Ai, q is true w.r.t. M, denoted by 
M. \= q, if M |= q for each M € A4. For a program P, q is true w.r.t. P, denoted 
by P \= q, if mods(P) |= q. 

The answer of a CQ ?(X) w.r.t. a set of models Ai, denoted by ans(q, A4), is 
the set of substitutions cr| x s.t. M \= a\^(q) for each M S A4. The answer of <?(X) 
w.r.t. a program P, denoted by ansp(g), is the set ans(g, mods(P)). Note that for 
a BCQ q, either ansp(g) = (if P \j= q) or ansp(q) = {<r\$} (if P \= q; <j\® is the 
identity mapping). The same consideration also applies to ans(g,7W). 

2-4 The Query Answering Problem 

Let C be a class of Datalog^' v programs whose terms belong to Ac U Ay. In this 
paper we call query answering (QA) over C the following decision problem: Given 
a program P £ C and a BCQ q, determine whether P |= q holds. In the following 
we will call class C QA-decidable if QA over C is decidable. 

We observe that computing ansp(g) for a CQ g(X) of the form is Turing- 
reducible to QA as defined above. In fact, ansp(q) is defined as the set of sub- 
stitutions <j\x s.t. the BCQ c| x (g) is true w.r.t. P. Since cr| x £ ansp(g) implies 
ojx(Ay) C terms(_P) n Ac, only finitely many substitutions have to be considered. 
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3 Universal Model Sets for Datalog^'^ Programs 

In this section we generalize the notion of universal model widely used in the context 
of QA over Datalog 3 programs. Intuitively, a universal model M of a Datalog 3 
program P is such that each model of P is homomorphic to a subset of M. 

Definition 1 

Let P € Datalog^' v . A set M. C mods(P) is a universal model set for P if for each 
M G mods(P) there is M' G M and a homomorphism ft s.t. h(M') CM. □ 

Universal model sets are sufficient for QA over Datalog^' v programs. 

Theorem 1 

If M. is a universal model set for P, then P \= q iff M \= q for each BCQ q. 
Proof 

Immediate because A4 C mods(P) by Definition [TJ 
(<=) Assume A4 \= q. Let M be a model of P. We have to show that M \= q. 
By Definition [TJ there exist M' G M. and a homomorphism ft s.t. ft(M') C M. 
Since A4 |= q by assumption, M' G A4 implies that there is a substitution cr 
s.t. cr(atoms(g)) C M'. Therefore, ft o cr(atoms(g)) C ft(M'), and combining with 
ft(M') C M we obtain ft o cr(atoms(g)) C M, i.e., M |= q. □ 

We now design a strategy for identifying a universal model set for a D&talog' y 
program P. First, we introduce the notion of fires of a rule r G P on a set i? of 
Datalog^' v ground rules. Next, we define an instantiation procedure for computing 
a ground program inst(P), the models of which form a universal model set for P. 

Let r be a rule of the form ((TJ, and be sets of ground rules. A firing 

substitution for r w.r.t. i? is a substitution a s.t. cr = cr|x and er(body(r)) C 
heads(i?). The firing of r on R' w.r.t. a yields a ground rule <r(r), where cr is 
obtained by extending cr|x as follows: 3- variables in Y are assigned to the least |Y| 
nulls not occurring in R U R'. (We assume a fixed well-ordering of Ajv and that 
variables in Y are processed according to their order in r.) A firing substitution for 
a rule r is said to be spent if it has already been fired. 

Procedure 1 illustrates the overall instantiation procedure. It consists of an ex- 
haustive series of fires in a breadth-first (level-saturating) fashion yielding a (pos- 
sibly infinite) ground program inst(i- > ). 



Procedure 1: program-instantiation 

Input : A Datalog 3 ' v program P 
Output: The ground program inst(P) 

1 #:=0; 

2 repeat 

3 R' := 0; 

4 foreach r£P and foreach unspent Bring substitution o for r w.r.t. R do 

5 |_ R' := R' U O(r)}; 

6 R--RUR'; 

7 until R' = 0; 

8 return R; 
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Example 1 

Let ipi < tf2 < ■ ■ ■ be a well-ordering of A n . A run of Procedure 1 on the following 
program (obtained from the one given in the introduction by predicate renaming): 

n : c(X) v h(X) <- a(X) r 3 : a(Y) <- p(X,Y) 

r 2 : 3Y p(X,Y) <- c(X) r 4 : c(lion) «- 

starts by setting P and R' to the empty set. The only firing substitution w.r.t. R 
is the identity substitution for whose fire yields itself, which is then added 
into R' . Rules in R' are moved into R (lines 6 and 3). There is a new firing sub- 
stitution for r2, namely o\ s.t. o\ = 0i|{x} an d = lion. The fire of o~\ yields 
pClion.i^i) <— c(lion), which is added into P', and then moved into R. Now there 
is a firing substitution for r$, namely 02 s.t. 02 = °2|{x.y}i 02 (x) = lion and 
02 (y) = ipi, whose fire yields a(y>x) <— pClion.^i). After adding this rule into R' , 
and then moving it into R, there is a new firing substitution for n, namely 173 s.t. 
03 = 0"3|{x} an d 03 (x) = <y5i- The fire of 03 yields c(<^i) v h(</?i) •(— a(i^i), which is 
added into R' , and then moved into P. Now there is a new firing substitution for 
r2, namely 04 s.t. 04 = 04|{x} and o"4(x) = <^i, whose fire yields p(^i ,^2) <— c(<£>i). 
The procedure thus go on, indefinitely. Let J = {c(lion), pClion.^i), a(<^i)}. 
Subset- minimal models of inst(P) have the following forms: 

• Uie[i..fc] {ctVih pf.fi.fi+O, a(</>j+i)} U I U {h((^ fc+ i)}, Mk > 1; 

• U»>i {c(<^), pCipi.Vi+i), a((p J+ i)} U J. □ 

In order to show that mods(inst(P)) is a universal model set for P, we first point 
out some relationships between the models of P and those of inst(P). 

Lemma 1 

Let P be a Datalog 3,v program and P' = inst(P). For each M G mods(P) there exist 
M' G mods(P') and a homomorphism h s.t.: (i) M' C heads(P'); (ii) ft(M') C M; 
and (iii) ft = /i| te rms(P')- 

Proo/ 

Let M G mods(P) and Pi — {r*i, . . . , r*j} be the first i rules in P' (w.r.t. the order 
induced by Procedure 1). We prove by induction that, for each i > 0, there exist 
Mj G mods(Pi) and a homomorphism hi s.t.: Mj C heads(Pj); hi(Mi) C M; and 

ft-i = fti|terms(P,;)- 

The base case, for j = 0, is vacuously true by choosing Mq = and ho the identity 
mapping. Let us assume that the claim holds for some i > 0, and let us extend Mj 
and hi in order to show that the claim holds for i + 1. 

Note that rule rj+i has been obtained by a substitution and a rule r G P of 
the form ([TJ. Note also that hi o is a substitution because /ij = /ij|terms(P;) by the 
induction hypothesis. If hi o<r(body(r)) C M, there is a substitution 0' D (hi 00) | x 
s.t. 0'(head(r)) n M ^ (because M is a model of P by assumption). Otherwise, if 
hi o <S-(body(r)) M, let u' = A, o 0. Let /jj+i be the homomorphism s.t. t G 0"(Y) 
implies hi+x(t) — <r'(t), and t £ 0"(Y) implies hi+x(t) — hi(t). Let Mj+i be the 
following set of atoms: Mj U <r({a G atoms(r) | cr'(a) G M}). 

The following properties hold by construction: Mj+i C heads(P i+ i); /ij + i(Mj+i) C 
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M; and hi+i = ^i+i|terms(p i+ i)- Hence, to complete the proof, we have just to prove 
that Mi + i is a model of Pj+j.. In fact, this is the case because: rj+i is satisfied by 
construction of Mj+i; rules of Pj are satisfied by Mj+i because they are satisfied 
by Mi, and atoms in Mi+i \ Mi do not occur in Pj by construction of Mj+i. □ 

A universal model set for P can be obtained from mods(inst(P)), which allows 
for answering queries on P by performing the reasoning on inst(P). 

Theorem 2 

Let P be a Datalog^ y program and P' = inst(P). Model set M = {M E mods(_P') | 
M C heads(P')} is universal for P. 

Proof 

By Lemma [TJ for each M £ mods(P) there is M 1 £ .M and a homomorphism h 
s.t. /i(M') C M. It remains to show that M C mods(P), i.e., M £ mods(P') s.t. 
M C heads(i-") implies M 6 mods(P). Let r £ P and a be a substitution s.t. 
(r(body(r)) C M, so cr is a firing substitution for P' . Let <r(r) be the rule of P' 
obtained by the firing of r. Thus, head(<r(r)) n M ^ 0, i.e., M |= <r(r). □ 

The program produced by Procedure 1 is a generalization of the oblivious chase 
procedure (jMaier et al. 1979l|Johnson and Klug 1984| ) , which associates every Datalog 3 
program with a universal model. In fact, the oblivious chase procedure can be ob- 
tained from Procedure 1 by replacing line 5 with R' := R' U <r(head(r)), which is 
enough for Datalog 3 programs. 

Corollary 1 

Let P be a Dataiog 3 program. Then, {heads(inst(P))} is universal for P. 

4 Extending guards-based classes to Datalog^' v 

We next define subclasses of Datalog 3 ' v relying on a well known paradigm, called 
guardedness, first introduced bv lAndreka et al.l(|1998p in the definition of the guarded 
fragment of first-order logic and further revisited by I Call et aD (|2008|) for defining 
Datalog 3 subclasses. In the next section, we show that all these new classes both 
depend on (easily) checkable syntactic properties, and are QA-decidable. 

Definition 2 

A Datalog B ' v rule r is said to be guarded if it is of the form: 

VX3Y disj [x , uY] 4- guard [x] , s-conj^,,], (3) 

where X' and X" are subsets of X, guard r x i is an atom called guard and denoted by 
guard(r), s-conjj x „] is a conjunction of atoms called sides and denoted by sides(r). 
Moreover, a guarded rule r is called: multi-linear if each side atom could be chosen as 
guard; linear if sides(r) = 0; monadic-linear if sides(r) = and all head predicates 
are unary. Hereafter, a Datalog^'^ program P is called Guarded (resp., Multi- 
Linear, Linear, Monadic-Linear) if each rule r £ P either is guarded (resp., multi- 
linear, linear, monadic-linear) or has an empty body. □ 

We now introduce the notion of affected positions of an atom, which are the only 
positions where nulls might occur in the output of Procedure 1. 
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Definition 3 

Let P be a Datalog^' v program, a be an atom, and X a variable occurring in a 
at position i. Position i of a is (inductively) marked as affected w.r.t. P if there 
is a rule r E P with an atom b 6 head(r) s.t. pred(b) = pred(a) and X is cither 
an 3-variable, or a V-variable s.t. X occurs in body(r) in affected positions only. A 
variable X occurring in the body of a rule is unaffected if it is not affected. □ 

The above definition is now used to define the class of weakly-guarded programs. 

Definition 4 

Let P be a Dafcalog ' v program, and r s P be a rule of the form: 

VX3Y disj [XuY] <r- wguardfx^s-conjjx,,,], (4) 

where X' C X = X" U X'". Rule r is said to be weakly- guarded w.r.t. P, if 
each variable in X'" \ X" is unaffected in r. Here, guard(r) and sides(r) still de- 
note the (weak) guard and the side atoms of r, respectively. In the following, 
Weakly-Guarded-Datalog^'^ will denote the set of Datalog' y programs where each 
rule cither is weakly-guarded or has an empty body. □ 

The new Datalog^' v subclasses introduced in this section generalize important 
fragments of Guarded-Datalog^ already analyzed in the literature. (Note that 
Weak/y-Guarded-Dataiog 3 ^ generalized Weakly-Guarded-Datalog^ because for 
disjunction- free programs Definition [3] coincides with the the notion of affected 
position introduced by I Call et~a l. 2008.) 

Proposition 1 

Definitions [5] and @] generalize the classes Guarded-Datalog 3 , Linear-Datalog 3 , and 
WeaJdy-Guarded-Dataiog 3 defined bv lCali et aLl([2UU5)) . 

We now pinpoint the complexity of recognizing programs in these classes. 

Theorem 3 

Checking whether a program belongs to Guarded-Datalog B ' v , Linear-Datalog^' v , 
or Weakly-Guarded-Datalog^' v is decidable, and doable in polynomial-time. 

Proof 

Checking whether a program is guarded (resp., linear or multi-linear) is doable in 
linear time by inspection of the rule bodies. Concerning a Weakly-Guarded-Datalog^' 
program P, we observe that Definition [3] introduces a monotone operator for deter- 
mining affected positions, and the number of such positions is linear in the size of 
P. Hence, all affected positions in P can be determined in quadratic time. □ 

5 Decidability Results 

We now show that all classes introduced in the previous section are QA-decidablc. 
In particular, we use results recently established by Ba rany et al.| (|2010|) on the 
guarded fragment of first-order logic (jAndreka et al. 19981 IGradel 1999|) , here de- 
noted by Guarded-FOL and inductively defined as follows: (i) base(Ac U Ay) C 
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Guarded-FOL; (ii) if ^1,^2 £ Guarded-FOL, then -rtpi, V 1P2, ^1 A and 
ipi -02 also belong to Guarded-FOL; and (iii) if a[ XU Y] G base(Ac U Ay), 
V>(X' UY') e Guarded-FOL, and the (free) variables of a include all the free vari- 
ables X' U Y' of V, then 3Y(a [XuY] A V(X' U Y')) and VX(^(X' U Y') <- a [XuY ]) 
are also in Guarded-FOL. 

Any Guarded-Datalog 3 ' v program can be viewed as a Guarded-FOL formula. 

Proposition 2 

There is a logarithmic space transducer associating each Guarded-Datalog^ :V pro- 
gram with a FO-equivalent Guarded-FOL formula. 

Proof 

For a guarded Datalog^' v rule r of the form ©, let hr x / uY .i be the i-th atom in 
disj[ X , uY ], with i G X'^ C X', and Y^ C Y. Rule r is translated into the 

following FO-cquivalent formula: 

VX(3Yihpc, uYi] V • • • V BYfehfx^Y^ V -s-conj^,,] <- guard [x] )- 

The whole disjunction is an expression U X") in Guarded-FOL because each 
3Yihj X , UY .j is equivalent to 3Y^(hr X , UY i A hj x , uY .j) e Guarded-FOL, and since 
-is-conjj x „] trivially belongs to Guarded-FOL. Moreover, the expression VX(?/>(X'U 
X") guard[ X i) is in Guarded-FOL since X' U X" C X. Finally, a similar con- 
struction applies to rules having empty bodies. □ 

QA-decidability of Guarded-Datalog 3 '^ and its subclasses can now be established. 

Theorem 4 

Conjunctive QA is decidable under Guarded, Multi-Linear and Linear Datalog^' v . 
Proof 

The result follows from Proposition [2] and from the fact that conjunctive QA is 
decidable under Guarded-FOL flBarany et al. 2010"] ) . □ 

In order to prove that WeaJdy-Guarded-Dataiog 3 ' v is QA-decidable as well, we 
first introduce the notion of weaJc instantiation. 

Definition 5 

Let P € WeaJdy-Guarded-Datafog 3 ^. For each r € P, let winst(r) denote the set 
of partially ground rules associated to r and consisting of the set {r} or of the set 
{er(r) | er is a substitution from X'" \ X" to terms(P) n Ac} according to whether 
rule r has an empty body or is of the form (j4|) , respectively. The weak instantiation 
of P, denoted by winst(P), is defined as the union of winst(r) for each rcP. □ 

The above definition transforms any WeaicJy-Guarded-Data7og 3,v program into 
a FO-equivalent Guarded-Datalog 3 '^ program. 

Lemma 2 

Let P be a Weakly-Guarded-Datalog^' w program and P' = winst(P). Then, both 
P' G Guarded-Dataiog 3 '" 7 and inst(P) ~ inst(P') hold. 
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Proof 

Assume that Procedure 1 builds isomorphic sets of rules for P and P' up to a 
given iteration of the repeat-until loop. We shall show that this isomorphism can 
be extended to the succeeding iteration. For each firing substitution a for a rule 
r G P, there are o\, o-i s.t. a = 02 °<ti, where o\ is a substitution from X'" \ X" to 
terms(P) n Ac. Let r' — ci(r). Therefore, r' € P' and o~2 is a firing substitution for 
r'. Consider now the other direction. Let a' be a firing substitution for r' G P' . Let 
r' = cr(r), where r G P and a is a substitution from X'" \ X" to terms(P) n Ac- 
Therefore, a' 00 is a firing substitution for r. The isomorphism can thus be extended 
by opportunely mapping new nulls. □ 

We can thus conclude that WeaJdy-Guarded-Dataiog 3:V is QA-decidable. 

Theorem 5 

Conjunctive QA is decidable under Weakly- Guar ded-D at alog^ ,v . 
Proof 

The statement directly follows from Lemma [2] and Theorem |4j □ 

6 Complexity Analysis 

In this section we study data complexity of QA under different classes of Datalog^' v 
and queries. As usual in this setting, we assume that a Datalog^ :V program P is 
paired with a (finite) database D C base(Ac'). The set of ground facts {a <— 
a G D} is denoted by D. Similarly, % denotes the singleton {a } for some atom 
a G D. Finally, whenever P contains a rule r of the form disj 4— (even if |disj| = 1), 
we replace it in P by disj ^— edb and we add to D the extra (propositional) atom 
edb of arity zero. Hereafter, we assume D = {ai, . . . , a„}. 

6.1 Guarded-Datalog^ v 

We start by providing an upper bound for QA over Guarded-Datalog 3 '^ . 
Theorem 6 

Data complexity of QA over Guarded-Datalog B ' v programs is in coNP. 
Proof 

From statement 5 of Theorem 19 in |Barany et al.| (|2010p . data complexity of de- 
ciding whether a CQ is true w.r.t. a Guarded-FOL formula is in coNP. The claim 
therefore follows from Proposition [5J □ 

We now pinpoint the complexity of QA over Guarded-Datalog^' v . 

Theorem 7 

Data complexity of QA over Guarded-Datalog By programs is coNP-complete in 
general, and it is coNP-hard already in the following cases: 

1. A Monadic-Linear-Datalog s/ program under an acyclic CQ. 

2. A Multi-Linear-Datalog y program under an atomic query. 
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Proof 

(1) QA is coNP-hard already in the following setting: a database and an acyclic 
CQ involving only unary and binary atoms, and a single (nonrecursive) Monadic- 
Lmear-Datalog 1 rule containing two head atoms. This result follows from Theorem 
6.4 (and its proof) of lCalvanese et al1(|2009j) : Let <j> be a 2+2-CNF formula, namely 
a CNF formula where each clause has exactly two positive and two negative literals. 
Let D be a database containing an atom lit (a;) for each prepositional variable x, 
and atoms p 1 (c,xi), p 2 (c,a;2), niCca^), n2(c,X4) for each clause x% V x-i V -i xz V -i X4 
having c as identifier. Let P be a Monadic-Linear-Datalog w program consisting 
of the following rule: t(X) v f (X) 4— lit(X), and q be the following acyclic CQ: 
3 C,Pi,P 2 ,Ni,N 2 p 1 (C,Pi),f(Pi),p 2 (C,P 2 ),f CP2).ni(C.Ni),t(Ni),H2(C,N2),t(N2). 
Hence, <f> is unsatisfiable if and only if P U D |= q. 

(2) The coNP-complctc problem 3-UNSAT can be encoded by means of an atomic 
query wrongAssigmnent over the following Multi-Linear-Datalog v program P: 

sel(Li,Ni) v sel(L2,N 2 ) v sel(L :i) N 3 ) i- clause(Li ,L 2 ,L 3 ,Ni ,N 2 ,N 3 ) . 
wrongAssignment 4— sel(L,N), sel(N,L) . 

As far as database D is concerned, each clause £\ V £2 V £3 of a given 3-CNF formula 
(j> is encoded in D by the ground atom clause("^i", "£2", "£3" , n{£\), n(£ 2 ), n(£s)), 
where n(£) = u —ix" if £ is a positive prepositional variable x, and n(£) = "x" if £ is 
a negative propositional variable ->X. If there is a satisfying assignment for (j>, then 
there is a model of P U D not containing wrongAssignment. □ 

6.2 Weakly-Guarded-Datalog^ 

As in the disjunction- free case, the complexity of QA over Weakly-Guarded-Datalog 3 ' v 
is harder than QA over Guarded-Datalog^'^ . 

Theorem 8 

Data complexity of QA over Weakly-Guarded-Datalog By is EXP-complete in gen- 
eral, and it is EXP-hard already for atomic queries over Weakly-Guarded-Datalog 3 . 

Proof 

Hardness comes from the EXP-hardness of Weakly-Guarded-Datalog^ (jCali et al. 2008[) . 
As for the membership, let P be a Weakly-Guarded-Datalog 3 ^ program and P' = 
winst(f U D) be the Guarded-Datalog^' v program built according to Definition [5] 
By Lemma H P U D \= q iff P' (= q. Moreover, let k be the maximum number of 
unguarded (thus unaffected) variables appearing in some rule of P, 7 be the num- 
ber of constants occurring in P, and w be the maximum arity over all predicate 
symbols in P U < D. We point out that \P'\ < \D\ + \P\ ■ (w ■ \D\ + 7) fc . Hence, in 
data complexity, the size of P' is polynomial in the cardinality of D. |Barany et al.| 
(2010) have shown that QA over a Guarded-FOL formula is in 2EXP in the general 
case. However, this double exponential dependence is only in terms of q and w. 
If P and q are considered fixed, then the complexity is simply exponential in the 
size of P' . Moreover, since P' can be translated in logarithmic space into a FO- 
equivalent Guarded-FOL formula by Proposition [21 then we have an EXP (w.r.t. 
the cardinality of D) algorithm deciding whether P' \= q. □ 
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6.3 Atomic Queries over Linear-Datalog^'^ 

In the following, let P be a Linear-Datalog^' v program and q be Boolean atomic 
query. As before, D = {ai,...,a„} is the input database. We first introduce a 
decomposition property relying on the structure of P. 

Lemma 3 

Let C be the set mods(P U %_) x • • • x mods(P U < a^), and M be {Mi U • • • U M n \ 
(Mi,..., M n ) G C}. It holds that M = mods(P U %. 

Proof 

(C) Let (Mi, ... , M n ) G C, and M = Mi U • • • U M n . To prove that M is a model of 
PUB, we have to show that whenever for a rule r G P there exists a substitution <r 
s.t. cr(body(Y)) C M, then M |= (r(head(r)). Let us fix a pair (r, cr) s.t. er(body(r)) C 
M. Since P is linear, there is i G [l..n] s.t. cr(body(r)) C Mj. But since Mi is a model 
of P U %, then Mi \= cr(head(r)). Finally, the implication holds since Mj C M. 

(D) Let M be a model of P U D. For each i G M is also a model of P U 
Consequently, the n-tuple (M, . . . , M) belongs to C, entailing that M G .M. □ 

The following lemma represents a logspace Turing reduction from the problem of 
evaluating q over PU D to the problem of evaluating q over PU% for some a G D. 

Lemma 4 

P U 'T) |= q if and only if 3z £ [L.ra] s.t. PU%^ q. 
Proof 

(=>) We prove the contrapositive. Let us assume that Vi £ [l..n] PU^ 9. Thus, 
Vi G [l..n] there exists a model M, s.t. M 2 ^ g. Therefore, Mi U • • • U M n \f= q and 
by Lemma [3] we obtain P U D Y= Q- 

(<=) Since 3z G [l..n] s.t. PU%, |= g, then M |= g for each M G mods(P U 
By Lemma SI PU^D (= g. □ 

Lemma 0] allows for focussing the analysis on a single database atom, say a G D. 
The instantiation-tree for P U % is the directed acyclic graph T = tree(P U %) 
inductively constructed as follows: (i) the root of T is a node labeled with ta; (ii) 
for each node m of T and for each rule r G inst(P U %) s.t. body(r) appears in the 
head of the rule labeling m, we add a node n labeled with r along with an arc from 
m to 7i. (See Example [5J) Let nodes(P) and arcs(T) denote the nodes and arcs of 
T, respectively; label(n) denotes the ground rule used as label for n; n G T is short 
for n G nodes(T); subtree(n) is the tree below n; finally, depth(n) is the depth of n 
in T, defined as the length of the path leading from the root of T to n. 

Definition 6 

The stem of PU a, denoted by stem(P U %), is the maximal subtree that can 
be obtained starting from the root of tree(P U %) in such a way that each path 
contains no nodes labelled with rules with isomorphic bodies. Finally, sinst(P U %) 
denotes the set {label(n) | n G stem(P U %)}. □ 
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Stem ( P exfZ\ u ( d(0) ) (d(0) ^ 



(a(yi) <-d(0)) [e(0) <- dCO^ 

I 

[b(y?i) Vc(yi) <- a(yi)] 



[d(yi) <-b(yi^j ^ (d(yi) <- c(yi)j ^ 

fa(</3 2 ) <- d((/3i)J [ e(<pi) <- d(i/?i)] fa(^ 2 ) <- d(^i)J fe(^i) <- d(<^i)J 

" + " f ' ' 



(b~(y>2)^c(v?2) <-a(y2)] [bQ^2n^c(y 2 ) 4-^a(y 2 )] 

(d(y> 2 ) <- b(y> 2 )) (d(y 2 ) <- c(y 2 )j (d(y 2 ) b(y 2 )] (d(y 2 ) <- c(y> 2 )) 



Fig. 1. The instantiation-tree for P ex ^ and d(0), and their stem. 
Example 2 

Consider a database atom d(0) for the following program P ex ^ 

3Y a(Y) <r- d(X) d(X) <- b(X) e(X) <- d(X) 

b(X) v c(X) i- a(X) d(X) <- c(X) 

The instantiation-tree is reported in Fig. [IJ where we also highlighted the stem. 
Note also that there are many isomorphic subtrees. This is due to a structural 
property of tree(P U ^a), which we highlight in the next lemma. □ 

Lemma 5 

Let m,n be two nodes of T = tree(P U %) s.t. body(label(m)) ~ body(label(n)). 
There is a node m' G T among m and its siblings s.t. subtree(m') ~ subtree(n). 

Proof 

The statement holds if m = root(T) or n = root(T') because in this case n = mas 
only the root of T can contain a rule with an empty body. Otherwise, let m p , n p 
be the parent nodes of m and n, respectively. By construction (relying on Proce- 
dure 1), body(label(m)) C head(label(m p )) and body(label(n)) C head(label(ra p )). 
Let label(rj) = (r(r), where r is a rule and a is a substitution. Let h be the isomor- 
phism between body(label(m)) and body(label(n)). Thus, there is a child m' of m 
s.t. label(m') = h o<j(r), which in turn implies label(m') ~ label(n). We now use 
induction. Let n, ni, . . . , n& and m', m[, . . . , m' k (k > 0) be two isomorphic paths in 
subtree(n) and subtree(m'), respectively. Still by construction, there is a one-to-one 
mapping /i between the children of n^ and those of m' k s.t. for each child n^+i of 
nfc it holds that label(nfe + i) ~ label(^(nfc + i)). □ 

Given a model M of sinst(P U %), we shall show how to build a model M* of 
inst(P U %) s.t. M* |= q implies M \= q. Let S = stem(P U %), and C be the 
smallest subset of nodes(S) satisfying the following properties: (i) root (5) G Co; (ii) 
ne Co whenever its parent belongs to Co and body(label(n)) C M holds. We can 
thus restrict model M as follows: M = {b G M | b G head(label(n)) A n G C }. 
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Example 3 

Consider again the instantiation-tree reported in Fig. [H Let M — {d(0) } U {a(y>i) | 
i > l}U{b(^ t ) i > l}U{c(^) | i > 2}U{d(<^) | i > l}u{e(^j) | i > 1}. Nodes 
in Co are those colored in gray, and Mo = M \ {c(</?i) \ i > 2}. Note that Mq is still 
a model of the program, as formally established by the next lemma. □ 

Lemma 6 

If M is a model of sinst(P U ei), then also Mo is. 
Proof 

Let n G nodes(5')\ Co, m be the parent of n, b be the unique atom in body(label(n)), 
and b G M . We claim that head(label(n)) n M ^ 0. By Procedure 1, since b G M , 
then b G head(label(m)). Moreover, according to the definition of Co, if m belongs 
to Co, then also n does. Hence, m g" Co implying that there is a node m' in Co 
s.t. b G head(label(m')). But this means, since b G Mo, that there is a child n 1 of 
m 1 s.t. n' G Co and label(n') = label(n). However, since by construction the head 
of each node in Co has a nonempty intersection with M, then head(label(n')) = 
head(label(n)) has a nonempty intersection with M). □ 

From T = tree(P U we define a total function / : nodes(T') — > nodes(X') as 
follows: For each node n G S = stem(P U %), f(n) = n. For the remaining nodes, 
let n G nodes(T) \ nodes(S') s.t. its parent belongs to S. Let m be the (unique) 
node in the path from root(T) to n s.t. body(label(m)) ~ body(label(n)). Let m' be 
either m or one of its siblings according to whether label(m') ~ label(n). Function 
/ thus maps subtree(n) into subtree(m'); it is total by Lemma [5] As a remark, we 
have that n ~ f(n), for each n G T. Moreover, f(n) = n if and only if n € S. 

Finally, we build the set C* and the model M* of inst(P U %) s.t. M* |= q 
implies M \= q. Initially, C* and M* coincide with Co and Mo, respectively. Sub- 
sequently, for each node n G nodes(T) \ nodes(S') s.t. both parent(n) G C* and 
body(label(n)) C M*, C* is augmented by n and M* is augmented by the set 
{b G head(label(n)) | /i(a) G M*} where h is the isomorphism between n and f(n). 

We now prove that QA can be performed by only considering rules in the stem. 

Lemma 7 

It holds that inst(P U %) |= q if and only if sinst(P U %) |= q. 
Proof 

(<S=) Since sinst(P U %) C inst(P U %), each model of inst(P U %) is also a model 
of sinst(P U 

(=>) Let us assume that inst(P U %) \= q holds. Let M be a model of sinst(P U 
Since, by construction, M* is a model of inst(P U %), and since M* |= q by 
hypothesis, then M |= q holds. □ 

Tractability of atomic QA over Linear-Datalog^' v can now be established. 

Theorem 9 

Data complexity of atomic QA over Linear-Datalog^ v programs is in LOGSPACE. 
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Proof 

Armed with Lemma [7j a logspace procedure iterates the database atoms looking 
for an atom a S D s.t. sinst(_P U %) |= q. In fact, for each n G stem(P U %), 
depth(n) < |7r| • (2w)"', where w is the maximum arity over all predicate symbols in 
P, and 7r is the number of predicate symbols occurring in P. Therefore, cardinality 
of the ground program sinst(_P U %) does not depend on D and neither does the 
number of its minimal models, which are sufficient for QA. □ 

6.4 Discussion 

Table [1] provides a comprehensive overview of complexity results that follow from 
the results obtained in this section and in the literature. Each row reports the com- 
plexity of QA for each of the classes defined in Section|4]together with either atomic 
queries (AQ), acyclic conjunctive queries (ACQ) or conjunctive queries (CQ). In 
each row we differentiate between the presence or absence of existential variables 
and disjunction: 3- variables in rule heads (column {3}), disjunctive heads (column 
{V}), and both (column {3,V}). 

Results in the {3}-column are from (Cal i et al. 20081 ICali et al. 2009[) . results for 
Weakly-Guarded-Datalog y (last cell in column {V}) follow from Eiter et al. (1997), 
since this class coincides with Datalog' . All the remaining coNP-completeness re- 
sults follow from Theorem[7]in Section IBTTl the remaining EXP-completeness results 
follow from Theorem [5] in Section 16.21 and the LOGSPACE upper bounds follow 
from Theorem [5] in Section 16.31 

Let us first consider the impact of allowing disjunction in the presence of exis- 
tential quantifiers in rule heads, i.e. columns {3} versus {3, V}. We can see that 
in most considered cases, the problem becomes (potentially) harder, except for the 
class Weakly- Guarded. Indeed, for this case the problem is provably intractable 
already without disjunctions, and turns out to remain so when including them. In 
most other cases, we actually identify a tractability boundary, passing from ACo 
to coNP-completeness. Notable exceptions are Monadic-Linear and Linear with 
atomic queries, in which case the problem remains tractable (but may be slightly 
more complex). It is interesting to observe that in the presence of disjunction the 
nature of the query has a huge impact on complexity for classes Monadic-Linear 
and Linear, while this is not the case in the absence of disjunction. 



Table 1. Data complexity of QA in Datalog^' 



Datalog 


Query 


Datalog Extensions 


Restrictions 


Structure 


{3} 


{V} 


{3,V} 


(Monadic- )Linear 


AQ 
ACQ/CQ 


in ACo 
in ACo 


in LOGSPACE 

coNP-complete 


in LOGSPACE 

coNP-complete 


Multi-Linear 


AQ/ACQ/CQ 


in ACo 


coNP-complete 


coNP-complete 


Guarded 


AQ/ACQ/CQ 


P-complete 


coNP-complete 


coNP-complete 


Weakly-Guarded 


AQ/ACQ/CQ 


EXP-complete 


coNP-complete 


EXP-complete 
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Let us now discuss the impact of adding existential quantification in the presence 
of disjunction in rule heads, i.e. columns {V} versus {3, V}. We can see that in all 
considered classes except for Weakly- Guarded, adding existential quantifiers does 
not alter complexity. This is a notable result, since having existential quantification 
is a powerful construct for knowledge representation. Only for Weakly- Guarded we 
obtain a significant rise from coNP-completeness to EXP-completeness and thus 
provable intractability. 

In future work, we intend to investigate on the exact data complexity of atomic 
QA over (Monadic-)Linear-Datalog^' v programs, in particular whether it is in ACo 
or not. We also intend to study the impact of disjunction on other tractable frag- 
ments of Datalog 3 based on different paradigms, for example stickiness (|Cah et al. 2010aj) . 
shyness (jLeone et al. 2012| and weak-acyclicity (Fagin et al. 2005). Moreover, it 
would also be interesting to broaden the study to combined complexity or to limit 
it to fixed or bounded predicate arities. Finally, also investigating on implementa- 
tion issues, for example in DLV 3 (jLeone et al. 2012]) . is on our agenda. 
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